11/88/2801 83:52 7a3418227& 


EXPFESS PATENT SVCS. 


PA(£ 82 


,1 


(12) 


UK Patent Application .«.GB o„2272285 ,»,A 


(43) D^tttof APubHcatlon 11.0S.19M 


(11) Application Uo W11732J 
(22) Datiof FSltng 07.06.18B3 


(30) Prlorit/Data 
(31] d»2283 


(33) 1(U>€11BS2 

2B.oai0az 


(33) GB 


(71) Appflcwitif) ^ ^ 

ThA Si«nttBTy oT State for Defined 

Drfcnw lW«*r* AeWy, PABNBOBOUaH, Harta^ 

QU14 ffTD, UiiltBd KiNgdom 

(72) InvAAtorW 

(74) A^mtand^or Address for S0ivie9 
RWBaeMmm 

iRtvilectual Property D^pvtmm. 
EMene* Rnamh A^nrf. Rfi9 Bolhfin^ 
DRA Fanteougb, RAftNB0f«)LX3H^ Henta 
GU14 m IMtad Kin^doni 


(SI) ma? 

QOSK 15/70 

(62) UK CL (Edition M) 

G1A AAJD AA3 AG17 Aft? At2Q ATa 
UlS 61821 S1881 

(56) Dooumants Cited 
G8221ffitf/ A 

(56) Field of SBarch 

UK CL (Edition L » 61 A AAJ . G4A r»C . H4D DLFB 
IMT CL^ IS/M 1B/6a 15/70 , (SOOK 9/36 8/40 
OnUne dstDliaso ^WPI 


(54) DetennMnothopodtJonof 9^8w^>«*Bom«*irtirtfibd64. 

(57) TTils Invendon relates to o method for digitally processing en fmsga in tho form of a digitised black and 
white video pSctuffi in order to locate the edgee and/dr corners of objects In the Image. The method works by 
comparing, f6r each point or element In the dfgidead fmege or errey* the bdghtneee of elemente located wrthin 
fi predetomrned region (eg 2,4,^^) Catered on the choson etemont wHh the l^rfghtne?^ nf the element 
Ifsalfta detgrntinethoaeetemerttshevlngeubstanttallyeqiialbridhtheas. All ft 00 
belonging to the seme surfece tn the Image. The method then locates tiioee elements whksh are associated 
wKh a minimum number of equally bright elemente within thdr local re^on and tiiese located elements wilt 
He on or doeo to an edge of tho Imsgo. OnOotho ©dg^ elemente have been located In thte weyr standard 
mediods of non-^exlmum suppression and edge thinning can be applad to find the poerbon of the edgd moiTe 
accurately. Comers appear as elements aasodated with lower minima because there are fewer equally bright 
elements In the vidnlty of a comer then eround en edge. 


Thb prim tatea account of replacement dpcumertto *ubmltted after Iha dat9 vf fWlne V> 6^bl6 thd applteatfon to comply 
with the formal requiromante of the Patents Ruleft 1 WO. 

Thb print Incorporates corroctlorw made undor 5«t^n 117(1) of thp PaterttoA^1 1977. 


w 

ro 
ro 

00 

<J1 


11/08/2B01 03: 52 7034182276 


EXPRESS PATENT SVCS. 


PAGE 03 


f5 


Fig. 1. 
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Fig.3a. 



Fig. 3b. 
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Fig.^b. 
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Fig. 7. 
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Fig. 6b. 
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Fig. 6c. 
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fflrnff "'^'^^"^ mmnrn thftrftln 

The present i.«rention relates to a oathod for digitally processing an 

to locate the eds«e of 6bJ.ct« In the Icaga a«d to « «PPai.*taB for 
doli th. B»«. A secon. -pect of the p««nt Invention relates to a 
.ethod for digitally procassiB. an U.^ to locate /^^^"^^ 
tho l«aga and to an apparatuB for daJ«g the Ba«8. In partxcular this 

Lantion ralat« to a «t»^ digitally prooeaains i»agaa be 
used in a »tbod for rooonatructins a 3'D deacTiptiOP of a scene tro. a 
covins iaags of the scene for the guidance Of unmanned vehlclea and «obxle 
robot syatOTS* 

,,^ut this docu.ent "corners" are considered to fall wit*ln tho scope 
of the term "eages". ft coroer being a part of an ed«6. 

A great deal of vision research Ues In the field of -early visioa- which 

as its purpose the reduction Of the anount of date eontaiwd m an 
iinage so that the data becomes »ore .anageable and -ore Imediateay 
useful. The a»ount of data can be reduced by extracting data free the 

relating to the positions of edges or corners of o^J-** 
1,^. one aim of this research is to use su.& data obtained fW« an 
l«ge created by a detector located on a moving vehicle to guide the 
Bovlng vehicle in real time. 

There are four main properties that eultehU edge and comer f Indars have 
to possess la order to be useful in real ttoe applications, and these are 
as follow: 

(a) The edge/comer finders should locate the edees/coiners of 
objects in en image aalddy enough to be used in real time 
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sppllcations. 

(b) TbB edge/corner finders should produce ft highljr stable output. 
Thftt la. the number of correct ©dgea/eoniers detected should be 
as high aa poseible and the nuaber of falsa edfiss/coroers 
detected shouia be at a mlniaum. 

(c) An edge/corner abould be located eoatinumwly 9b the image waves. 

(d) The edge/comer fladeu ahotfld Jecate the edges/corners In an 
iBBge as accurately as possible, lhat Is, aa edge/comer should 
be located at precisely the rlgj»t place in the inttfi!©. 

In addition to thla an edge finder should exhibit conplete edge 
connectivity ftt jtmetlons, ia. edges detected by the edge detector should 
join wh©i?e one or more edges neet at Junctions. 

Many diffferent methodfi Of locating the edges in an Unaga haye aro««red In 
lite*atu*e covering this area of research. The najortty of these methods 
work by taking Inage bplgSitaieas differences between neighbouring lasge 
positions to create en "edge strength" inaeo. However these nethods can 
becone unstable end ineocurate When the iOBge noise is hi^. 

Sinilarly nany different methods of locating the comers in an Image have 
appeared in Uterature covering this area of research. The different knO«A 
comer finders ea£ih have a different definition of a comer which is 
translated into a method of procesBlng the impga, fpne^al^Jr la accordance 
with A ftatheaatical algorithe. These methods generaUy inwoive the use of 
isage brightness spatial derivatives in the algorithm, particularly first 
and eeccmd derivatives. The problem with using spatial derivatives is that 
again they are affected by noise in the imago and to redUOe the effect of 
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noise, tbe l«ge ct the derivatives have to be B»00thed ^ this leads to a 
reduction iA accuracy. 

AODUcatlonB. One wy Of overcoming thle aieaoTvaas^ 
dlLop dedicated hardw«. for the edea/coma. detector In or^r to 
i,^la«nt the «t^d »ora culddy. However. deslBolng such dedicated 
hardware can be costly and tiw consuming, 

preaant invention aaal- to ovarco»e at Icaat ao« of the -^^r^tl^ 
TaaLantagea ^ provldln, a aet^ of digitally processing ia ord« 

to l^«.tB the ed^ and/or cor*«re therein «nich can locate 
t,7or coders in an accurate end StaUa -saner, '.uiddy aaoug^. to be us^ 
in real tlae appUfiAttionS, when enbodled In software. 

»..«rflnz to a first aspect of the present iwentlon there is provided a 
r^rof JUtU processing sa l«ge. to locate the edges of objects In 
the inage. cowrlaing the Steps of S 

(a) representing the 1-age by a first two di«easlonal data array of 
eleaents coaprlsing iaage values, 

««rating on ead. ele^t in 1^ first array, to determine the nu^ 
of ele-eata. n. located within a predateralned regioa centred on the 
- olaaent being operated on which have aUbBtantially the sa»e Image 
value as the elenent being operated en, aad : 

(c) locating the ale-eats assadated with local oi«l»a In the said 

jtuiobecs n* 
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The OOthod accordlns to tha present Invention does not employ any Image 
bPightneoB spatial derivatives. It does not therefore incoi^OMte & 
smoothing process and ao retains accuifacy. Also, it can loeata edges up 
to 10 tines boW quickly than Imovm nethodo. 

m the method according to the present invention each element la the iaags 
(except those which are eo dose to att edge of tho inege that 
predetarained regions cannot be cftAtred on then) iP operated on. either 
eeeuentially 0J^ eUniltaneouely. When en element Is operated on. a 
predetermined region centred on the element being operated on (hereinafter 
referred to as the nucleus element) is interrogated to detenaljao the 
number n of elemente within that region having a Bisilar ioffige value to 
the nucleus element t 

The n elBBents wblch have a BiMlar image value are then asBUoed to be 
part of tho sane surfaca in the inage. The fl*ea within the predetemlned 
region which eoi«»ise6 these n elefnente vith a Bl«llar= image value la 
herolnftftor referred to as the univaloe area. It can he seen Inaadlately 
that the tinlvalue area will decrease fnm ita maxlmufli (which is tlie area 
of the predetermined region) idien an iwge edge is e»rO«hed. If ft 
straight edge is approached, then tho uolv«aue aroa will dec^eaw to half 
of the aifea of the predetermined region as the predetennlned region Is 
moved twarda and onto the edge. As the predetermined region is moved 
past the edge, the univalue area will start to increase again. Thus 
elements associated with local minima in the rtuabers n will be th© 
elements located on or near to edged in the image. This is ho« an edge is 
found accOtfdlag to the ppeae»t Hwentlon. The inage value of an element 
will generally be the brl^tness of the part of the Image represented by 
the elenent. 

Iteferably step (c) Includes locating the eleuentfl asaodfttBd with numbers 
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„ which are leaa than a seo«etrlC threshold g. If the tmlvalue area 
covers a large p«portlon of the predeter-lned region tbeii tho oleaont 
being operated on will not generally be located on or near Wl edge. 
Therefoi^e these elements can be disregarded by aottlng g to a «ultaWLe 
proportion of the nu-ber of eleoente In the pi«detero.ined region. The 
orocewlng involved in locating the edge elenents Is therefore very 
sl^la. Once the edge elaente have been located In fltandard 
.ethods of non-»*ixl«» «Ppre«lon and edge thinning can be applied to pin 
point the position of the edge »ore aoou^Ately. Preferably, the geo-etrio - 
threahold g la bet-een 65% and 85^ of the WPber of eleoenta In the 
predete«nlned region, benaaae within this range very few non-edp elements 
are located ao edge elements and very few edge ele«ents are not located an 

Per many appUcations of the psesait invention, for example, for 
reconstructing a 3-D deacriptJcm of a aeene froa a -ovlng laose of the 
scene, the edge dlreetinn aaaodated with each edge element -uat be 
identified. The edge direction assodated jrtth an edge eleeent la the 
direction of the tangent to the edge which pasaea through the edge 
element. The edge direction J«i9t also be found when non-maidBum 
suppreasion is to bfe perfot«d and when it is necessary to apply 
edee-thlnning tecbni.,ue8 to locate the posltlc«i of the edge to aub-eleoent 
accuracy. 

ihe method according to the present invention allowa edge direction to be 
determined quidOy ^ accurately by tha addition of the following steps; 

(d) operating on each element of the s^d first array which is 
located in step (c) (herelnBfter referred to as an edge 
element) by coi^ei^ihB t»»e number n associated with the edge 
element being operated on with a preset threshold. 
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(e) 


(f) 


operatiJis on each edge elem^fttt asBOCi&ted with a nuober n 
which Is greater than the preset threshold i^y locating the 
centre of gravity of the elenente within the preaetermlned 
region centred on the edge element being operated On which 
iveve subBtantlally the seme image value as the edge elanent 
being operated on and designating a direction perpendicular to 
a l-fp** conneCtlflg said centre of gravity and the centre of the 
edge oleaent being operated on as the edge direCteion for the 
edga eleaent being cverated on. and 

operfttlnB on each edge olewnt asBOCiated with a number n 
vAxich ia less t*an the preset threshold by locating a longeefc 
axis of eyaaetry for the predetennlnad region centred on the 
edge elenent being operated on and designating the direction 
of said longest axis of symaetry as the edge direction for the 
edgd alement being operated on. 

For a ehaip edge which coaprlses elements of a fiJfSt briigxtaess to one 
side of the edge end eleaenta of t second, different brl£?itneeB to the 
other Bide of the edge. Step (e) is foUowed to find tho edge direction. 

thia case the edge dlreetion Is slwly prapendicular to a line Joining 
the centre of seii^ty of the unlvalua area and the centre of the nudeoB 
element. For a blurred edge where, there le a thin band which has a 
brl^tnesa roughly half way between the brlfijhtnesaes of the two regions 
.which generate the edge, step {f) is followed. Clearly the imlvalue area 
of an edge eleaent on a sharp edge will be larger, than the unlvalue area 
Of an edge element on a blurred edge, as the latter will generally 
comprise a line of elenents which pasBes thtoufiji the nucleus eleaant- 
Hence the preset threshold can be ueed to distlnguiah between these two 
types of edgea. Preferably the preset threshold Is spproxliiately the 
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aiaaeter of the preddterBinea region In eleaentt. ie. the number of 
elenentB thftt Ue on s diematep of the predstermlned region. 

m ijorderllne cases between a sharp and a blurted edge thero is a 
tendency for atep (a) to be followed when it would be more appropriate for 
step (f ) to be followed. To rtaedy thlB a further atep can be included 
which coaprlaea comparing the distance betweai the c«itre of gravity and 
tbd centre of the edgB element being operated on in at^ (6) with a 
tbTMhold distance end if the said dlatance la leaa than the preset 
threshold dlatance the rest of atep (e) is not followed and atep <f) la 
followed inatoad. The thwehold distance is preferably sec to 
appctndiiiately on© sixth of the dianoter of the ptedetemdned region. 

The aethod according to the pteaent Invenfeioa can be adapted easily to 
locate the comers of objects in the liaage. According to the second 
0 aspect of the preaent invention, for locating comers of objects In the 
idage. a nunber n is a local mlnlBa if it le less than all the nwAere n 
associated with the elenenta within a predetemined nlniaifllne, area 
centred on the elenent associated with the said nuaber n. Using this 
definition of a local >inlna restrlete the ele-ente located by tho nethod 
to edge eleaents that are located at comers of objects in the l«ge. 
ie. comer eleirents. The unlvalua area of an edge elBoent located at a 
corner la eenerally smaller than that of an edge elCtteat not located 
at a comer. In the neighbourhood Of a comer there wlU generally be a 
snail grouping of eleeonta that have reXatlvely eniill unlvalue Breaa 
^aociated with thea. Tho eiiact position of the comer can be found by 
locating the elenent within eadi such grouping which has the 
BBslleat unlvalue area. Thie is how a comer la defined according to the 
present invention. 

In the Mthod for locating a comer element step (c) preferably includes 
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the steps of eompartns the said numbers n »lth a Bso-etric threshold s 
which is less than or equal to half the nuaber of elemsnta In the 
tredeteriained region and operating only on the eleaente asaoclated with 
n«»be« leas tixan s to locate the ele!»»ta associated »lth local -Inl-a In 
the said nuabers n. If the area Of the univalue region Is nore than half 
the area of the predetermHwd region then the eleaent betas operated on 
Ml not gehorally be located on a convex edge of ft surface. Ble»enta 
that ere not located on a convex edge of e surf Me will not be located at 
a comer, therefore such eleeeote can be dieregarded. More preferably the . 
gBoeetric threshold g Is exactly half the miiober of eleeente In the 
predetemdned region. This threahold is preferred because it will allow 
the t««iw» *ense of types of comere to be reported. When a straight 
edge includes the element being operftted on the number of elBaents in the 
univalue area will alweyo be greater than half of die eleeente In the 
predetermined region, see Figure 1. A anudler value of g results i« only • 
"sharpen" comers being detected. 

preferably the predetendned olnlaieing area is a sduare of 5 by 5 
elei»nts. A mlnlidflii»8 area of thie size has been found to be large 
enougb to detect only true comere and yet snail enou^ for all comers 
dlBcenilblD to the eye to be located. Also, the larger the tdniinlsing 
area the longer the processing tskes. 

SometlDes the *ethod fOP locating comere accordlne to the present 
• invention «iU report an element as a comer when Ia fact it la not. This 
-occurs particularly where there Is a slight blurring of the Uiage. m a 
blurred inage et a coemon bouodaty wheco two regions of . different 
brisbtoees meet there «ay be a thin Wne of elements of a third 
Intemedlate bri^tnesa. Ihis line is often broken up end only one 
elaaeat thide and so it may cause comers to be wrongly reported- 
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(a') 


This problsD can be fiubatantUilly eliminated acconMng to a preferred 
enbodlBBnt of the present Invention «hich c««iM6M In edition to etepe 
(a) to (c) , the steps of; 

Qperatlns on each element In the aald first array which Is 
located in step (c) (hereinafter referred to as a «»«tter 
eleneat) by locating the centre of jfravity pf the elements 
within the predotdMlned region centred on the comer elenent 
belAff operated on which have substantially the sane inage 
value as the comer element being eperated on. anfl 

(e') aisregarddng the comer eleawt being operated on as ft corner 
element if the centre of gravity is within a predeterailned 
dletance fro« the comer eletient being operated on. 

The uolvalne area will have a centre of gravity that la not dose to the ^ 
element being operated on foe a tree comer, see Figure 6a, False comers 
are rejected because a thin line passing through the elemertt being 
operated on will have a short dlatanee from the centre of gravity to the 
element h^i^ operated on. see Figure 6b. The preferred netbod with 
additional steps (d') and (e') does not aignlfleantly reduce the speed of 
the eethod eccordiag to the present invention as only elements p«Vloualy 
reported as comers in step (c) are operated oo. 

The Pethod for locating comers according to the present invention may 
\lso report false comers When the image contains a considerable amount of 
fine BtniCture or image noise. The false comara reported for such images 
can be substantially eliminated by forcing the univalue srea to be. to 
some extent, a eingle block of elements of similar brightness as opposed 
to elements of the same brightness scattered throughout the predetermined 
region. 
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A further ppeferped wbodUnent of the present Invention, baa bean 
developed to substantially all»lnate this problem, which co»priaeS 
e^aSlUon to at^a (a) to (c). (d') and (aM tba atepa of; 

(f • ) operating on each cortar element not diaregarded In step (e- ) 
by dataifflinlBB Wither a prBdetaraUied number y of elemente 
which extend ftoa the comer elenont being operated on in the 
direction of the centre of gravity have auhstantilfllly «« same . 
UBBgB valua as the corner eleaent bdag operated on. and 

(E«) diacountine the comer Ol«ant being pperated on as a comer eleifflDt 
if one or -ore of the aaid y elen«.ta doea not have the same value «a 
the comer element being operated on. 

AgBiji the preferred aethod »hi«* addlUooally coB^prlaes etepa (f) and 
(g') doea not alsnlficantly r^ce the apeed of the method accoifdlikS to 
the present Invention as only elenenta that are comer elaaeats are 
operated upon. 

Preferably the predeteralned region la s«bstanUally circular and nore 
proferably coapriaea a square of 5 by 5 elemanta with «wee eleaenta *Med 
onto the centre of each edge of the aauare. If the region la B«aller than 
this then the results eeoerally tend to b«o»e unatable end if the region 
13 Breatei> the results tend to oalt the edges associated with the amalleat 
-Structures in the laage that are identifiable by the eye. Furthemore a 
large? region reduces the speed of the nethod according to^ the present 
invention. In methoda for locating edges a predatermiMd region of 3 by 3 
eleaents la preferred if the iiiage contains Wltlple edges which run very 
close to each other. 


t 
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When dealing «d.th sliople gteyecale l-iJges (Where the image value has juat 
a single variable asBociated with it) the iaage value of an elenettt will 
generally be the greyScaXe brtghtneas of that part of the inage 
repreaeatefl by tha element. Parts of an tBaga. with a Sl«e of the order 
of Ui« predetermined region. rAldti are part of the fa»e surface BeneraUy 
have eubstantlally the ea» bPlfihtw^e. This IB the case for both colour 
and Bonochrome i-agea. It aay bo poaalble to use other image values 
derived from the original Image, for exanple. the Image brightness 
gradient, witbovt degrading the perfon«nce of the method acwrding to the 
pi^eot invention. In the more complex case of vector .images («here each 
laage value baa more than one variable aaaoclated with it) then the fuU 
vector can be used as thd image value without necessarily affecting the 
way Ui© rest of the aathod works. 

Preferably an element la considered to have substantially the same image 
value as the element being operated oa if It differs in brigfatneas fwa 
the element beii« opewted «i by 50 grayscale units or leas. Ibis 
brlgbtneaa thtwbold does not affect the quality of the reaulte but does 
affect the nuaber of edges that are reported, beCWise it determines the 
allowed variation in brightness within the univalue area. A reduction In 
this threshold causes the method according to the present invention to 
pick up more subtle variations In the image end report a correspondlnsly 
greater nwbber of edgea. "Ibis threshold must be set according to the 
ceatramt in the image and can be tuned to give the required density of 
reported edges. A fixed value of around 25 greyscale units is suitable 
ftar almost all real images a»d if low contrast images are encountered the 
bn^tness threshold can be set automatically, aimply by Varying it to 
give the required density of reported edges. 

According to a third aspect of the preseat toventlon there Is provided 
apparatus for digitally proCOSfling images in order to locate edges 
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comprialns » conputer set up to run a computer progritfi ftCCOPdlng to the 
methods described above. Preferably the apparatus additir»ally includea 
data input means for receiving fcha iaage 6Ai relayiJig l«age values derived 
from the laage to the computer. Preferably the data input eeans coinpriBes 
e Video cemera and a digltifiiflg neflM for convertins the output of the 
Video camera into a digital fore that can be input into the coaputer. 

FBbodiBente of the present invention will now be deacrlbea by way of 
example only with reference to the followJj»g draMinga in whichs 

Figure 1 ie ft BCheaatic representation of a firet two dineDSiCoal data 
ai^ray of eleaents cooprislns laage valuaa according to tbe present 
iBventioQ. with ftour predetendned regions ana reapective nucleus eleaants 
superiaposed tbereom* 

Figure 2 is A e(flifiaatic representation of a second tw dinensional data 
array which corresponds to the first array Shorn in Figure la and which 
contains edge etrettgthe {g - n)» with g set at 27- 

Figure 3a shows part of a first two dlaenaional data array that has a 
Sb@rP diagonal edge l^lng actoaa it. 

Figure 3b shows the preaeterolDefl reglpn centred on element of Figure 
3e. 

Tigore fta ohowe part of the two dlmaisional array that has a blurred 
diagonal edge lying across it. 


figure 'ib shows the predeterminefl region centred on element of Figure 
4a. 
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Figure 5 18 e scheaatic wprMentfttlon of a second two dlmensioflftl aAtft 
array «h±ch corresponda to tha first array ahown in Plgw^e la and which 
oontalM edge Btrengtha (g - n). with e aet to 18. 

PiBWeB 6a to 6b show three predatemi^ed pagloas with roBpactive nucleus 
slementa and centres of gravity ewperlinposed thereon. 

Figure 7 BhoHs a^paratua according to the present inveation. 

one e«boai«eDt of the method according to the present invention will be . 
discussed with refarenc* to Pigurea 1 and 2. 

Figare 1 flhew a fi»t two dlaBoaional arrty 10 of eleaente 20 i*ich 
contain iMgO values. The image coBprleefl a dwk region which haa iaage 
values Of ^.praxiiDately 75 (tl»6» values are ahaded over) and a 

llAt region which has toage values of approximately 25- „Pour 
preaetenained reglono 2. ft. 6 and 8. each coapriaing 37 fil«»enta are shown 
with nucleus elei«nta 12, 14. 16 and l8 respectively, "n^ unlvalue area 
within each predeterffllnad region coBprisea the eaementa within the regl«» 
that have aubstsntially the B«ae image value sa the mideua element. Jn 
the region 2 the univalw area contaJM 13 eleaents le. n - 13. i^ W*« 
l», n « 22. in region 6, n - 17 and in region d, n - 37- The geonetrlc 
threahoM g 18 set at 27 wldeh is Just under three gwrtera of the number 
of elements in the predetermined region. If the unlvalue area comprlsea a 
nuaber of elenents n less than or equal to g then an edge strength g - n 
is placed in a second array 30. in Figure 2. to the position corresponding 
to the nucleus eleaent. Claarly. of the above, only the regions 2, * and 
6 comprise a number n of elenents within the unlvalue area that la leaa 
Xiisa or equal to 27 • 

Referring now to Figure 2 which abowa the second two di-onalonai array, or 
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edge strength Inage 30 of eldi^Qfitfi vfaich corresponds to the first artay 
10. The n e 13 assoclatecl with tho region 2 in the first array 10 
produces an edge strength g - n « l4 which is inserted in the second array 
30 in the position 32 corresponding: to the position of the nucleus element 
12 in the first arrsy. The n ■ 22 assodated with region k produces an 
edge strength 5 which is located in the second array In the position 34 
corresponding to the position of the nucleus eleaent l4 in the first 
array. SlSLilarly the n » 17 associated vlth the region 6 produces an edge 
strength 10 which is located in the second array in the position 3^ 
corresponding to the position of the nudsus element I6 in the first 
array. Iri way all values of n associated with regions in the firet 
array which ere less than 2? ere r^I^es»t6d in the second array hy an 
edge strength g - n in a position corresponding with their associated 
nucleus elenents. If n is greater than g, a zero edge strength is 
generally inserted in the second two dlseasional array » however for 
clarity the elemwta with a zero edge strength in Figure 2 have been left 
blank. In Figure 2 this resttlta in groups of nuahers clustered around the 
poB^tiona associated with edges of the dark region in the iaage 10. 

A liat of edge etrmigths end their corresponding elenent poeitiond fron 
Figure 2 can be used to find the edge dlrectione associated with edge 
eleiDents end this In turn can be used for non-naxlQiijm suppressim in the 
direction perpendicular to the edge direction in order to locate the edge 
position more accurately « Fbr example, in Figure 2 the straight edge 38 
produces two rovs of edge strengths 5 one elti^ side of the edge 3B. 
«rherea0 the actual position of the edge 38 lies between the said two rows. 
(Ton-naxiJros suppression can be used to find the actual position of the edg 
38, once the edge directions are known. 

Figure 3a shows part of a first two dimensional data array which has a 
sharp edge v±th ol^nente with image values of around 25 to me side of the 
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edge and Imb© values Of around 75 to the other side of tha odgB. 
edge diction Of the edge shown In Figure 3e ia shown by the arrow k6, 

piB«e 3b ehowe the predetermined region centred on the element of 
Figure 3a. Tbe element fO would be located aa an edge elenent to the 
method described ebove. The edge direction of the element 40 ie 
calculated to tite foUowtog «ay. Firetly. the t,08ltion of . the centre of 
gPBTlty of the elements In the imlvalue area (lo. the ueeheded elements) 
le leeeted, by the standard matbematlcal method. The position of the 
centre of gravity Is ebo-n at Then the edge direction of the element 
HO 1,. the direction pext>eBdlcular to the line 50 Which joine the centre Of 
gravity US and the centre of the edge elewsnt 10. 

ngure Ua shows part of a first t«o di-enslonal data array which has a 
blutred edge with eleweets with image values of around 5 to one eS^e Of 
the edge, elects with 1-ege values of aioimd 95 to the other elde of the 
edge and a thin line of eleaents with leage values Of around 55 lyl^S on 
the edge. The edge direction of the edge show in Figure hs. is shown by 
arrow 52* 

Figure hb BbOWfl the predetermined region centred on the edge element kk of 
kB. dearly the method deacribed above with reference to Figure 3a 
ond 3b cannot be used to find the edge direction for edge eleaents like 
element Instead the edge direction con be found by finding the 
longest axle of eynaetry. 

The ttethod according to the present invention can dstetalne. which . , , 
calculation appUes to find the edge direction Of a papticolar eleaent by 
compaxlng the number n aeflOdflted Vlth that element with a preset 
threshold. This threshold is set to approximately the number of elomenta 
that span a predetermined region. In the present case afrprojcl-ately 7- 
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caearly. predetermined regioAS of the type shovm In Figure kb will 
generaUy hAvo ftUfflbors A (la this caaa n » 5) which are leas than 7 and 
the predet6i?ained resiOflS of the type shown in Figure 3b will generaliy 
have nuBbere n (In this case n «« 21) which are greater than 7. 

Heferrlng now to Pigorea 1 and 5. the aaeond aspect of the present 
invention for the detection of comara will now bo eiqplelned. 

For the detection of comers the eeonetrlc threshold is set to 
apprcDdiaat^ a half of Ute elements in tb6 predstMWiaea region, In this 
case it is set to 18. Roferrtug ba«ae to Figure 1. only predettennlned 
reeions 2 and 6 will bare »MiibeEfl n asBodated with them (13 and 17 
reepeetlvoly) Which are less than 18. Fleore 5 ahows Uto edge fltEongthB 
(g - n) that are Inserted In the second two diaenSional data arrfly 30' 
when B s 18, Txi Flguro 5 thia results in four eeoopa of numbers duatered 
eroond the poBitlo»8 aaaodated with comers of the dark region in Mio 
image IQ, The positioos of the maxlJoun numbers in each said group 
correspond to the poBltlooa of the comers of the dark reslon iA the iBage 
10. 

Referring MW to Figures 6a to 6e which show thv9» predetermined regions 
31^, 36 and 3d with nucleus eleMnts 14, 46 end 46 respectively, the 
centre of gravity of tlie unlvalue areas (shown shaded) can be located by 
the standard nothod and are ehowa by crosses 54, 56 and 58 respectively. 
AsBuod that nucleus eleaeots 44« 46 and 48 have been reported as comer 
^leaents aceordlng to the method discussed above In relation to Figuree 1 
an4 5. Theai according to one eabodinent of the present inventipn 
elements reported es comer elements are discounted as covae£ elements if 
the centre of gravity of the associated urtivelue area is less than a 
distance equal to 1 in units Of elements frcni the centre of the comer 
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The Bnaded unlvalue area in the predBtermlned region 3^* is the as 
that corresponaiPg to corned ele-^t 12 In Figure 1. 1^ centre of 
™ifcy 54 ie the Mia dlBtance away f «« tb^ centre of the 

^e«s cle»ent ond so the nucl^a el«e.t vUl bUII be r^rtsd as 
^ comer, -n^ univalue area In the predeter.l«ed region 36 le of the typO 
-xpaeted to result between two area, of differing brigbtneee in an i-age 
that la blurred and «»priee« a thin line of an lnt«rfl.edlate brlebtneas 
batweea two eaid areas. The nucleus eleoent 46 doea not represent a 
corner and ao it irould be undesirable for It to be reported as a comer. 
According to the criterion above nucleus els-eot ^6 will be dlecounted as 
^ comer because the centre of gravity 56 la than the said distance 
away from the centre of the nucleus elenent U6. 

The Shaded unlvalue area In the predotewinsd region 38 Bhows the type 
e^eted when there is a lot of fine semcture or noise in the Ittage. 
Fine structure or noise in the i«age will result in a large nunber of 
comers. Clearly in sucb a case It is preferred that comers of the type 
in the predetermined region 34 are reported in preference to comers of 
the type in the predetennioed region 38. According to a further 
enbodiinent of the present invention ft comer eleeent Is discounted as a 
comer eleeent If one or nore of the three elements esstendlag fro. the 
comer eleeent In the direction of the centre of gravity have a different 
bri^tneas to the comer eleoent. ClearOy the vnlvalua area In the 
prodaterelned region 38 would fail this test because element 47 has an 
^aga value that differ^ greatly from that of the nucleus eleeent 48 and 
would be discountai as a comer. 

PlBure 7 Shows apparatus for carrying out the above methods and conpr^ee 
a video camera 62 which records images and feeds them to a digitiser «. 
for example a Datacube Diglnwc board which feeds the digitised i-ages to a 
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co»p«ter 66. for example, a Sun worketdUon or a Meiko transputlnB 
surface. The computer 66 rune ac60>;dlns to a computer program which 
Operat«» aecordlns to the Mthod dlacussed above to locate the comers 
and/or edges in each image. 

One «Aofll«ent Of a f^^ter progrea for detecting edges aeoordlng to the 
present tovwtloa that can be uaed in the ««puter 66 compri*«s the 
folloHlns steps: 

B» tM> dimensional data arrays are set ttp vlth elements arranged In roiiS 
end columnB which ole«ienbi corresppna to the pixels In the Image being 
processed. The el«enta are identified by t»K> dimensional cartesian 
coordlnatea (x.y). The said data arrays will sd'^ierally be 256 elements by 
256 eleaents- 



The digital brl^tnesB in greyscale units of a pixel in the image at 
pOBltlon (x,y) is assigned to the corresponding element in e position 
(x.y) in the first twO dimensional data array. This is repeated for each 
pixel in the image. 

Each element in the first array la then operated on in turn except those 
«itblft three eloients of the outer edge of the data array. 

When a particular element is being operated on all the elements in the 
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array «^ disregarded ex«pt those thdt lie within the predetermined 
„gl« c^tred on the ele,.e.t being operated on. The rei^on «*0«en to 
l« . Bquara 5 elementa by 5 el«««ts with 3 elements added onto the centre 
OfeachedgB. This ah**e approjdJiates to a circle. The digital 
bnBt.tn««a value of aoCh ele«»t In the predetermined region is th^ 
"co^ed" with that of th. nucleus element according to the fcllowong 


equation; 


^U) - 1(3;,) 1^ 


^here &(x.y) is the position of the element being operated oa ii^ the 
array r(x.y) is the poeition of the element within the 1^^*^^ 
region be£»s -COBPOT^" with the element bein^ operated on, M is the ^ 
digital brlshtneae value of the ele-ent in position x(x.y> in greyscal* 
unite, t is the brlghtnese difference threshold and c is the output of the 
"cLpioMson". c(r.jc„) will be approximately equal to 100 if the 
brl^tnea« value of the element in position r{x.y) differs from the 
brightness value of the element In position «^(x.y) by less than t units 
and will be appro«l-ately zero otherwise. The brightness threshold t Is 
set to 25 so diat elements with brlehtness values within 25 gteyecale 
vnits of the nucleus element will have c<E.ro> approrimately equel to 100. 
the valiie cU.^) le f««nd for each element within the region IneludlnB 
-^he nucleus ele«nt itself and a running total, n. of the outputs c is 
Bade, according to the equation; 


n{x,y) C(g.go) 
C 

over 
predetermined 
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region 

This total n(x,y) 18 therefcwe 100 ti=e8 the «u»ber of elementB in the 
pr«teter«ined region that hava BubstentlaUy the sai» brightness ^ the 
nucleus element. 

Bach value »(x.y) Is then coroared to a flwd gBOcetrlc threshold. 

The geo«otrlft threshold b 1b eet to 100 tiaes of the xuafter of 
eleaents in the predeterolnBd region. 1«. 100 tlMS 72?^ 37 which is 
approxlaately 2650. If n{x.y) le lew than the geoiiietnc threshold then 
an edge etrength [g - tt(s.y)] ^ assigned to the element position (*.y) in 
the eeoond flpray coppesponding to the position of the aLeoent being 
operated cn m the first array, if n(x,y) is greats* than B then a zero 
is aflslgned to the elanMnt in a position (x.y) in the secmfl array. 

A list of the eWnta in the aeeond array. Idantlflad hy their position 
iu the array c'ti«.y). and the edge strength values asflodated «lth them 
indicates the position end strength of edgea to the laage. Such a Hat 
can be used in further standflrd proceSBing wtiwds to locate edges note 
accurately. 

^, f.'^ Aine thflL ffl ^g ft H4T.prt:lnn BHSonlated with fflfTP tffflnfintg 

Each elBBBnt in the first array that is aSflOdatod with a nuHiber n Whiiih 
la less than the geoaetric threshold g. le. all edge eleoente. are 
pperated on to find the edge direction aasociated with them in the 
following vay- 
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The number n(x,y) ftWoclsted with the element being oporated on i;„(x.y) Is 
then e««pared to a preset threshold, p. In this example, p - 700. which 
is 100 times the diawtor of the predetermined region elements. 

If n(x.y) > p then the centre of gravity of the nnivelue acea aaMClated 
with t^ element telng operated on is found. IWa ±a found by the 
Btandard method, with each eWnt in the predeteroined region wel^ted 
by the value cCr.j;,) gi^ above In equation 1. The centre of gravity is 
therefore found using the following equation} 


z 


where 1^,(1:,) is the position of the centre of gravity of the uiilv(>i«e 
area forsed lAen the predetennined region is centred on s^. 

The distance beti^en the centre of gravity i,,{r.) end the element being 
operated on r„ la then calculated. Ihis diatanoe is simply the eudldean 
distance, d. In elements, uBing the eauation; 


If d is more than 0.35 times the mask radius in elements, ie. 0.35 times 
3.5 which 16 apppojaoately 1.2. then the edge direction aasocieted with 
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the eleoent being operated on is peipendlcular to the line cormecti»S 
the centre of gravity and fi.. If d < U2 then the edgp direct*^ 

ie found hy flnflUsg the longest axle of symaBtry. 

Simaerly if n(x.y) < p the edge direction Is found by finding the 
longest BX±8 of fiyiDoetry Over the predeternined region. In practice, the 
longest mils of aysanetry is found by taking the sums: 


c 

predetexialned 
region 

over 
predetermined 
region 

and xy - ^^ (« • x„)(y - y„)c{g.r,>. 1 

over 
predetenttned 
region 

Then the ratio of to la used to deteroine the orientation of the 
edge and the sign of xy la used to detsPBin© whether a diagonal edge has a 
positive or negative gradient. 
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6. IflTH^t*'**'^™^ SimnrflftRton 

The list of edge Btrengtbfl Ie - n(x,y>] -ith as«oclat»d ele-^i: positions 
^(x y) and edge directions ci« then be processed furtter by noo-maximua 
Tupp^saloa. Non.»«cl-u. suppression 18 the euppresslon of non-»exl«u» ed 
etrengthe U ' M*M ^ lie near to an edge. The edge steeogth. 

be a -exlimm at the actual poflltlon of an edge and to either side of 
taie edge strengths will be smBller. but not necesBarily zero, 
Noi^«axl««- suppression ««,ve8 the smaller edge ettengths by finding the 
aajdmun edge atrength in the direction perpendicular to the edge 
direction. This 18 ft standard nethod that Is coMonly used In edge 
finding algorlthns* 

A co«.uter progra. for deteetlng comers aceordlnff to the second aspect of 
the present invention that can be used ixi the computer 66 coapriees the 
steps 1 to 3 of the program abo^ for locating edges, then the following 
Steps are followed: <= 

Rsch value n(x.y) Is then coBpared to a fixed geoaetric threshold g. 

The geometric threshold g is set to 100 nmltlplled by half the number of 
el«»«ts in the region le g c 1850. If n(«.y) is less than the geometric 
"ihreshold then a value [g - n{x.y)] U assigned to the element In the 
position (x.y) in the second array corresponding to the position of the 
nucleus element In the first array. If n(x.y) is greater than g then a 
zero le assigned the element in a position (x.y) in the second array. 
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Each element In tb6 aecond ««fay which do8s not have a value equal to sero 
iB then operated oa by conparlne the value of the element belns operated 
on (ifefwred to »a a central eleaent) with the values of all the other 
eleaents lewited within a region of 5 by 5 elewntft centred on the central 
element, if the value of the central eleaent 19 greater than those of all 
ths other eleaents in the eeid region of 5 by 5 elements then the 
corresponding eleaent in the fl«et array la- reported aa a pomer. 

6*. i^iit-iTig r^TitTf, of gravAtY 

The centre of gravity Of the univalue areas associated »dth elenenta 
reported aa comere (eerner elenents) are then calculated by the etaadard 
methematicai method, as eiove in equation a. with each eleaent within the 
predetermined region weighted by the value e{E,A.) 8i»aa above In equation 
i. 

7.. p ^ffff^j.iti^.m F' f^rnt^n w»im yn^^'T'"* ^"vft ^ ofintre Of ggfttfj g 

olnaft t^" cn mw element 

The distance between the centre of gravity t^^ii^) and the nucUus elenent 
r^ is then eelculsted. This distance is simply the euclldean diatanco, d, 
in elensitB, using equation k. If d is less than 1 then the comer 
elosnt IB discounted as a comer element. 

The bri^tnesB value of each remalAlne coiner element is cOAWared with the 
brightness values of the three Oleaents that extend from the comer 
element In the direction of the centre of gravity of the univalue area 
assoelated with the comer element. If one or more of the three elementa 
has a value of cte.JCo) ^ °^ ^ comer element Is 
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discounted as a corner. 


IMS entire procesa con be run on e MSG processor, using a 256 by 256 
pixel, lasee take* about 1/3 Of a second for an average scene. 

of the computer program the e<iuetinn X can be replaced by the 


In step 3 
follotfine: equation? 


{ p if 1 1{£) - Kro) 


< or » t & 
> t. 


H««ver usi^ff'equation fi Instead of fiawtlon 1 gives less stable results. 
Eouattori 1 allo-e an elenenfs btfightneSB to vary slightly without having 
a large effect on the value <rf c. even if it is near the threshold val^. 
Bjuauon 1 was chosen because it gives a similar «sponse to equation E 
but with subtly PWJnded comers. Other e.p.stionB with sJi-iilar responses 
can be used to place of equation 1. Bauatitt 1 can he i^leaented as a 
look up table for speadi 

The .aln application of the present Invention is in a two-dinensW 
l.age seff-entation systea which wUl tcack the comers found by the method 
aecortfiBg to tbe present Invention over tiae and allow analysifl of the 
seene in view so that sepal^ately BOVing objects nay be Identified. A 
video ca»ers feeds ixages to a digltiser ^ch feeds the digitised image 
"iata to the oomputop. This computer then runs the computer ppogram 
described above over each image relayed to it fWB the video camera In 
real ti». The speed of the method according to the present invention has 

this possible for the first tloe. This allows subsequent 
segmentation of the Ixage Into separately moving objects, by virtue of the 
variation ix^ the motion of the corners, using a 2-D segmentation systeni. 
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A second cottputer ppogrffn «ay also run in the computer, for exaople the 
DROID 3-D viaioB eystea developed by Plessey, which tracks the comers 
throu^ tlae la ovObt to construct a 3-D deacriptlon 6f the world. The 
eemers in the successive Images are followed Over aany iaaSM Uy the 
computer. The results of the 3-D 6tructure from aoUon progpam can allow 
a vehicle to avoid static obfltaclea. whilst the 2-D segmentation system 
can allow a vebielo to avoid or follow movljig objects or vdiicles. 
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1. A method of digitally processing an Ifflage. to locate the eflges of 
objects in tbe Ibubb. conprislng the steps of; 


(a) 


(b) 


represeatlng the iaflga by a f trst two dinanfllonal data arrW 
of elenwitB BoWrlelPg iJoage values. 

operating on each ele-ent In the fixfit arwy. to detetolne the 
mifflbar of eletaants. ft» located within a prefletennlned reg±«i 
centred oo thd elOPent being operated on *»hlch have 
SUbBtantlally the sane image value as the eleaent being 
operated on, 'and 

locating the eleaattts BSBOCiatBd with local ninlaia in the flold 
mmbera n. 

0 

2. A method of dl«ically processing an image ftfiCordSng to elaUi 1 Kherein 
sUp (c) inaudas locating the eleaents wsociated with numbera n «hich 
are less than a geoaefcrie thrdSbold. 

3. A method Of dlBlteOly processing an Image according to cl«l« 2 wherein 
the geometric threshold z i« beti^ ^% end 85* of the number of elements 

in tbe pretotermined region, 

4. A method of digitally ptoceealOB an Image according to any on© of the 
preceding claiiiS Mblch coopriees the additional stepo of J 

(a) operating on each element of the said first array «hlch is 
located in step {c) (hereinafter referred to as an edge 
element) by coBparlag the number n associated with the edge 
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element belne operated on with a preset threshold. 

(e) operfttiiig on each edge element associated with a nUiaber » 
which IB greater than the preset threahold hy loeating the 
centre of gravity of the elaaeatB Withta the ppedBtennlned 
region centred on the edge ©lenent being opemted on which 
have BubatanUany the saae loaga valaa as the edge deoent 
faelne opfetated en and designating a direction perpendicular to 
a line connecting said centre of gravity and the centre of the 
edge element being operated on as the edge direction for tb& 
edge eleaent being operated en, and 

(f ) operating on each edge eleaent assoclftted «l«i a nuBber n 

which 18 leas than the preset threshold by locating a longest 
axis of syimBtry of iisBge values owr the predetermined region 
centred on the edge eleaent being operated on and deslgiiating 
the direction of eald longest axis of symnetry os the edge 
direction for the edge eleaent being Operated on. 

5. A method of dleitally processing an laage according to claim 4 wherein 
the preset threahold ia epproJdiPfttely the diameter of the predetennined 
refi^on la elements. 

6. A method of digitally processing em iiaage according to claim k or 
claim 5 wherein the distance between the oentpe Of gravity and the centre 
df the edge eleaent being operated on in at^ (e) is coBq)ared with a 
threshold distancB and if the said dietanee la less than the threshold 
dlBtaace the rest of step (e) la not followed and acep (f) is foUowed 
Inatead- 

7. A method of digitally proceBfilng an image, according to claim 1, for 
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locating the conIel^8 of objects in the image, .herein a number n Is a 
local minlM if it is lesa than all the nu»b^ n associated with the 
ele«ept6 within a predeter-ined olnisising ar«a centred on the oleaertt 
associated «ith the said nuobetf n. 

8 A method of disitaUy processing an l«age according to clal» 7 
wherein step (O includes the steps of comparing the said numbare » with a 
BoometaMc threshold g «hich is less than or equal to half the number of 
elements in the predetermined regiort and operating only on the eleaeata 
aasoclated with mimbere n which e« leas than g to locate the eJe««ita 
associated with local Binlmft in the said nmnbers n. 

9. A nethod of digitally proceeatog an Huigo according to clai« 7 or 
claim 8 Wherein the predetenHned minlmlalne area ia a aauare of 5 by 5 
eleoentSa 

10. A method of digitally processing an imoga according to any one of 
deias 7 to 9 which comprises the Additlooel Bt^B of ; 

(d' ) opawting on each element In the said first array which ia 
located in step (c) (hereinafter referred to as a comer 
element) by locating the centre of gravity of the olerontS 
within the predetermined region centred on the corner element 
being operated on which have substantially the aaae Uaage 
value as the corner element being warated on, and 

(e« ) diaregarduig the corner olereat being operated on as a comer 
element if the centre of gravity is within a predetermined 
distance frflJii the comer eleeant being operated on. 

11. A method of digitally proceasing an ImegO according to claim 10 
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idilch comprises the additlonaX Steps of j 

(f) opdtatlng on each corner element not disregarded in step (e*) 
by determining whether a predeteralned number y of elements 
which extend from the oovM^ elw^At being operatea on In the 
airection of tha centrs of gravity have siibstantlally the SBDe 
ijnage value sa the comer element helne operated oii» and 

(g* ) dlflcomtlng the corner element being operated on as a comer 
element If one or more Of the B«ld y eleasnte does not have 
the aame value AS the comer ele»nt being operated on. 

12. A method of digitally processing en Image acoOifdlng to claim 11 
wherein y la 3* 

13. A method of digitally processing an Image according to any <b» of the 
preceding clalas whe*Oln the predeteroined region is Bubstaflttially 
Circular. 

1ft. A method of dieltaUy processing » Inage according to claim 13 
wherein tha predetomiinea region la a square of 5 by 5 elements with 3 
6lett»t8 added onto tOie centre of eadi edge of the square. 

15. A method of dldtally processing an image according to any one of 
claims 1 to 6 wherein the predetermined region is a sguare of 3 by 3 
elements. 

1$. A nathod of digitally processing an image according to any one of tha 
preceding claims wberela the image value Is greyseale bri^tness. 

17. A method of digitally proeeselng an image according to claim 16 
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therein el6i«ntB are considered to have substantially the same brightness 
if they differ In greyscale brightneBe by 50 greyBcale units or lees. 

18. A MtbO* of digitally processing iBages substantially as hereinbefore 
deeenbed with reference to the aeeompanyinK drawings. 

19 Apparatus for digitally proceaaiag an i»nge for lo«»tlng the edgca 
of Objects in the image comprising a co-pater.set up to run . a computer 
program for carrying out a -ethod according to any one of the preceding 
dalBB. 

20 Apparatus for digitally proceasing en iusge aecording to claim 19 
Wherein the waratus additionally Includes data input meanS for receiving 
the laage and relaying laage values derived from the image to the 
cooputer. 

a 

21. Apparatus for digitally proceaalog an image according to clai- 20 
wherein the data input neans canprlseB a video camera and a digitislsg 
„«ans for converting the output of the video camera iftto a digital foi« 
that can ba InpUt into the computer. 

22. Apparatus for digitally processing images Bubstentially as 
herembefore described with reference to the accompanying drawings. 
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